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ABSTRACT 

A  method  of  image  registration  based  on  matching  pat¬ 
terns  of  local  features  was  described  in  an  earlier  report. 
This  note  describes  the  use  of  gray  level  correlation  to 
hemdle  cases  in  which  feature  matching  gives  ambiguous  re¬ 
sults.  Substantial  improvement  in  matching  performance  can 
be  achieved  at  little  additional  computational  cost. 
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1.  Introduction 


Image  registration  is  a  key  step  in  such  applications 
as  multisensor  remote  sensing,  navigation,  stereomapping, 
change  detection,  and  pattern  recognition.  For  a  general 
introduction  to  the  subject  see  [1] . 


Classically,  image  registration  is  carried  out  by 
matching  pixel  gray  levels,  e.g.,  by  computing  the  normalized 
cross-correlation  of  the  two  images  being  matched  [1] . 

This  is  a  computationally  expensive  process,  is  sensitive  to 
geometric  distortion,  and  also  tends  to  yield  non-sharp 
matches.  An  alternative  which  is  generally  less  expensive  and 
also  yields  sharper  matches  is  to  extract  sets  of  distinctive, 
sharply  localized  features  from  the  two  images  and  then  match 
the  resulting  patterns  of  features.  Sensitivity  to  distortion 
can  be  reduced  by  using  "relaxation”  techniques  to  -determine 
compatible  pairings  of  the  features  between  the  two  images. 

A  set  of  experiments  applying  this  approach  to  several  differ¬ 
ent  types  of  images  is  described  in  12,3]. 

One  problem  with  the  method  in  [2,3]  is  that  it  depends 
on  extracting  sets  of  more  or  less  corresponding  feature  points 
from  the  two  images.  If  too  many  of  the  extracted  points  do 
not  correspond,  the  process  may  fail  to  discover  a  reasonable 
match,  or  it  may  detect  spurious  matches  in  addition  to  (or 
instead  of)  the  correct  matches,  due  to  accidental  correspon- 
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This  note  shows  how  spurious  matches  can  be  largely 
eliminated,  without  significemtly  increasing  the  computational 
cost,  by  combining  gray  level  correlation  with  feature  point 
matching.  Experimental  results  are  given  using  samples  of 
aerial  imagery. 
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2 .  Method 


The  steps  in  the  feature  matching  approach  of  [2,3]  can 
be  briefly  summarized  as  follows: 

a)  Feature  points  ("corners”  at  which  the  gradient  mag¬ 
nitude  auid  rate  of  change  of  gradient  direction  are 
both  high)  are  extracted  frcrni  both  images.  Thresholds 
are  adjusted  so  that  the  number  of  extracted  points  is 
about  the  same  for  both  images  (about  15  or  20) . 

b)  Tentative  correspondences  are  determined  between  pairs 
of  these  corner  points,  based  on  their  orientations, 
sharpnesses,  and  contrasts.  A  relaxation  process  is 
used  to  confirm  these  correspondences  based  on  the 
occurrence  of  correspondences  in  the  appropriate 
nearby  positions. 

c)  Each  svirviving  correspondence  determines  a  relative 
displacement  of  the  two  images.  If  enough  of  these 
displacements  form  a  cluster,  we  conclude  that  a  match 
between  the  images  has  been  detected. 

Our  method  is  designed  to  heuidle  the  case  where  more  than  one 
cluster  of  displacements  is  detected. 

Let  P,Q  be  a  pair  of  corresponding  points.  We  pick  small 
windows  centered  at  P  and  Q;  in  our  experiments  we  used  7x7 
windows  in  one  image  and  15x15  windows  in  the  other.  We  cross¬ 
correlate  each  small  window  with  the  corresponding  large  one, 
and  check  whether  there  is  a  correlation  peak  near  the  center 
of  the  large  window.  If  C  is  a  cluster  of  corresponding 


points,  let  C  be  the  subset  of  this  cluster  for  which  this 
correlation  condition  is  satisfied.  Let  A*  and  B'  be  the 
largest  and  second  largest  of  the  cluster  subsets  defined 
in  this  way.  If  |A'|>kfB'|,  where  k  is  a  parauneter  (>1)  and 
the  bars  denote  cardinality,  we  say  that  a  match  between  the 
images  has  been  found. 


3 .  Results 


Figures  1-2  show  two  pairs  of  images  used  in  our  experi¬ 
ments,  as  well  as  the  corner  points  extracted  frcxn  them. 

In  each  figure,  the  first  image  is  shown  on  the  left;  the 
smaller  image  that  was  matched  with  it  is  in  the  lower  cen¬ 
ter  position,  and  the  best  matching  subimage  of  the  first 
image  is  in  the  middle  center.  (The  upper  center  shows  the 
subimage  for  which  the  match  was  first  detected  during  the 
search  process . )  The  feature  points  extracted  from  each  of 
the  small  images  are  shown  next  to  it. 

Tables  1-2  show  the  matching  results  with  and  without 
the  use  of  correlation.  Each  table  shows  the  correspondences 
found  using  feature  point  matching  only.  (Part  (a)  shows  them 
for  the  upper  center/lower  center  match,  2mid  part  (b)  for  the 
middle  center/lower  center  match.)  For  each  corresponding 
pair  of  points  and  x^,yj)  we  give  the  relative  displacement 

(Xd,yd} f  the  number (clus) of  the  cluster  to  which  it  belongs, 
euid  the  displacement  (cor-cntr)  of  its  correlation  peak 
relative  to  the  center  of  the  window.  We  see  that  when  corres¬ 
pondences  with  badly  off-center  correlation  peaks  are  eli¬ 
minated,  only  one  cluster  survives. 


4.  Concluding  rem^u:ks 

These  experiments  show  that  local  gray  level  correlation 
cem  be  used  to  improve  the  results  of  image  registration  based 
on  feature  point  matching.  Since  this  correlation  is  performed 
on  relatively  small  windows,  it  adds  little  to  the  computa¬ 
tional  cost,  but  as  we  see,  it  is  quite  effective  in  removing 
the  ambiguities  that  sometimes  arise  when  feature  matching  is 


used. 
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